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The MAILING DATE of this communication appears on the cover sheet with the correspondence address • 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply Is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

I) S Responsive to communication(s) filed on 9/6^005. 

2a)|3 This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. ^ 

Disposition of Claims /^^^ fX'/^j 20-2lj X^^2.^ 

4) S Claim{s) 1*^ slare pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim{s) is/are allowed. 

6) M Claim(s^ 1-5.7-9.1 2-16.20.21. 23-25 is/are reiected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: aO accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawjng(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I) 0 The oath or declaration is objected to by the Examiner. Note the attached Office Action or fomi PTO-152. 

Priority under 35 U.S.C. § 119 

12)n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * 0)0 None of: 

1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Claim Rejections -35 use §103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2, Claims 1^9,12 17,2Ka5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ashby, III et al. (5,852,803) in view of Walters et al. (6,453,281) in further view of Jong 
(6173250). 

The US patent of Ashby et al. discloses a computer-based system and thus, 
necessarily includes the apparatus, the method of operation and the article of 
manufacture of this system. Consequently, rejections for claims 1-1 1, 12-20, 21-24 and 
25 have been combined, as they all address the same subject matter. Where 
appropriate, all interrelated limitations from these claims have been listed in the same 
location. 

Referring to claims 1, 12, 21, 25, Ashby, 1 1 1 et al. disclose: 
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inputting at least a portion of the electronically-readable identifier marked on an 
item (bar code and bar-code reader (1st device) col.2, In. 1-5 col.5, 

inputting from a user a spoken utterance that corresponds to the item (voice 
information and microphone 2nd device) coll , ln.63 - col.2, In.l and col.5, In .33-35)., 

associating the electronically-readable identifier (bar-code label) input from 
the item with the spoken utterance input from the user on storage device (81, FIG. 1 1) by 
use of processor (78, FIG. 1 1) (See also col.3, ln.36-39., col.5, In. 18-34 and col.9, 
ln.60-65); 

and outputting the spoken utterance when the electronically-readable 
identifier associated with the spoken utterance is subsequently inputted 
(speaker, 36, FIG. 1 1 and coL3, ln.36-52 and coL9, In.31-47). 

Ashby, III et al, do not disclose 

"converting the spoken utterance input by the user to text" and 
"associating electronically-readable identifier and the corresponding text. 
Note: While Ashby et al suggest the use of voice recordings instead of text data 
(CoL 9, Unes 48-57), Ashby et al.'s do not explicitly teach away from the converting 
user-spoken utterances to text. Ashby et al. only suggest that using voice recordings 
instead of synthesized data would improve user's experience. However, from the 
fiinctional perspective, Ashby et al.'s system would achieve the same goals of delivering audible 
information to the user if it were to synthesize this information from the text. In addition, as it 
would have been obvious to one of the ordinary skill in the art, Ashby et al. 's system suffers 
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from the inefficiencies associated with a storage and maintenance of a large number of voice 
recordings. 

Walters et al. teach converting user*s voice input to text (Col. 9, lines 41-50) for 
the purpose of recording user's voice records. As it is well-known in the art, text version 
of a document requires far less storage space than the voice-recorded version of the 
same document. In addition, it is notoriously known in the art of software engineering 
that management of text data (database storing, lookups, searches, etc.) is much 
simpler than the similar management of binary data, such as voice recordings (Col. 1, 
lines 42-55). Walter et al.'s system thus solves the problem of manipulation and 
maintenance of large number of voice records - the problems also associated with 
Ashby et al.'s system, since Ashby's system operates with a large number of voice 
recordings. 

Therefore, it would have been obvious to one having ordinary skill in the art at 
the time the invention was made to modify the method of Ashby, III et al. as taught by 
Walters et al to convert voice utterances to text because it would advantageously allow the user 
to be in command of a large amount of information with greater efficiency (Walters et al, col. 1 , 
Lines 42-55). In addition, examiner takes the official notice that it is extremely well-known in 
the art of software engineering to perform searches of the databases using text data, 
since it is the fastest and most efficient way which is currently available in the art of 
organizing and searching the databases. 



Application/Control Number: 09/8 1 7,475 Page 5 

Art Unit: 2655 

The combination of Ashby III et al in view of Walters does not explicitly teach using a 
remote speech-to-text (speech recognition) system 

However, neither Ashby et al, nor Walter et al. explicitly teach against connecting 
to a network. For example, Walter et al. teaches connecting to a remote database (Col. 
28, lines 40-45), while Ashby et al. also teach using a terminal workstation (74, FIG. 1 1) 
which would suggest a network connection in the modem days (at least after 1996, 
while Ashby et al's patent has been filed in 1992, when network connectivity was not as 
prevalent) 

Jong, however, teaches a method, wherein the speech-to-text conversion is performed on 
a computing device (speech recognition device, fig. 2, element #203) remotely located 
with respect to a computing system (SU system, col.2, ln.55-56) performing the other 
steps (coL2, ln.65; col.5, In. 13-33, fig.l shows systems 100 and 1 10), and archiving the text as 
needed (fig. 5, subblock s503). System 100 performs speech-to-text conversion and system 1 10 
performs text-to-speech conversion. The two systems are remotely located, and they are 
connected by a transmitting network). 

Therefore, it would have been obvious to one having ordinary skill in the art at 
the time the invention was made to modify the combination of Ashby, III et al. in view of 
Walters et al. as taught by Jong to have speech-to-text conversion performed on a computing 
device remotely located with respect to a computing system performing the other steps, 
in order to provide an efficient centralized way to transmit speech data and to facilitate 
speech processing of data in the speech recognition system of Walters et al. because, 
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the distributed speech recognition systems allow to offload heavy speech processing to 
dedicated (remote) computers, thus reducing the computational load on the local machines (Jong, 
col 1 Unes 30-40). 



Referring to claims 2, 13, Ashby, 1 1 1 et al. further disclose the method, 
wherein the electronically-readable identifier marked on the item is a universal 
product code (col9, ln.3 1-34). 

Referring to claims 3, 14, Ashby, 1 1 1 et al. further disclose the method of 
reading the universal product code from each item with a barcode reader (col. 9, 
ln.32-36, col 10, In. 21-31 and Fig. 1 , element #80). 

Referring to claims 4, 15, Ashby, 1 1 1 et al. further disclose the method, 
wherein the associating step comprises storing the spoken utterance corresponding 
to each item using the universal product code read by the barcode reader for each 
item as an index (memory, col9, ln.3 1-47 and colli, In. 1-3). 

Referring to claims 5, 16, Ashby, 1 1 1 et al. further disclose the method, wherein 
the outputting step comprises: subsequently reading the imiversal product code from 
an item with the barcode reader (col.9, ln.3 1-34); searching stored spoken utterances 
using the universal product code as an index (collO, ln.66 - col 1 1, ln.3) ; and 
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playing back the spoken utterance that is found in the search to the user (col. 1 1, 
In .3-7). 

Referring to claim 1, Ashby, III et al. do not disclose the step of converting 
spoken utterance to text by a speech recognition system. 

However, Walters et al. teach using speech recognition system to convert 
spoken utterance to text. (154, Fig. 4 and Col 9, lines 25-40) 
Therefore, it would have been obvious to one having ordinary skill in the art at the 
time the invention was made to modify the method of Ashby, III et al. as taught by 
Walters et al. to convert the spoken utterance to text by using a speech recognition 
system in order simplify the process of storing, maintaining and retrieving records 
(either synthesized or previously recorded) associated with the electronically-readable 
identifiers (Col. 1, lines 42-55) 

Referring to claims 8-9, 23, Ashby, III et al. do not disclose converting text 
back to speech when the system determines that electronically-readable identifier input 
from the item is associated with the corresponding text. 

However, Ashby et al. do teach outputting voice recordings when an associated 
electronic code is entered in the system (col.3, ln.36-52 and col.9, ln.31-47). As it has 
been explained in the rejection for claim 1, it would have been obvious to one of the 
ordinary skill in the art to modify Ashby et al to convert voice utterances to text and 
associate this text with the corresponding electronic labels for the easier storage and 
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improved operational efficiency. 

In addition, Walters et al. teach converting text back to speech using text-to- 
speech system for the playback of stored records (156, FIG. 4 and Col. 10, hnes 18-27) 
As a result, it v^ould have been obvious to one having ordinary skill in the art at 
the time the invention was made to modify the method of Ashby, 11 1 et al. as taught by 
Walters et al. to play back stored records associated with the electronic identifiers 
using text-to-speech conversion, in order simplify the process of retrieving data records 
originally stored as text and associated with the electronically-readable identifiers (Col. 
1, lines 42-55), particularly because, as it is well-known, text recordings do not require 
as much storage capacity as binary voice recordings. In addition, outputting audio data 
allows users to browse/hsten to records by audio means only, hence, improving the 
overall user experience for people incapable or disinclined to read product labels 
(Ashby et al.. Col. 1, lines 42-51) 

Referring to claim 24, Ashby, 1 1 1 et al, further disclose apparatus configured to 
be user-portable (fig. 1 1, top element #74). 

Response to Arguments 

3. Applicant's arguments filed 9/6/2005 have been fully considered but they are not 
persuasive. As per apphcant's arguments of page 2 of the response, Applicant's arguments do 
not comply with 37 CFR 1 . 1 1 1 (c) because they do not clearly point out the patentable novelty 
which he or she thinks the claims present in view of the state of the art disclosed by the 
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references cited or the objections made. Further, they do not show how the amendments avoid 
such references or objections. Examiner notes that appUcant's representative does pomt to the 
claim language, and does mention the references cited, but fails to present a conqDarison of the 
two other than a blanket statement that the references fail to teach the claimed invention. As per 
appUcants arguments that "any combination between Ashby and Jong clearly lacks legally 
sufficient motivation" and allegation that "the Office Action is based on the type of 'subjective 
belief and unknown authority'", examiner disagrees and points to the stated 103 rejection above 
wherein the stated reasons for combining the references have been explicitly taken from the 
references themselves. As per appUcant's comment on the bottom of page3 of the response, 
examiner notes that the provided statement was in response to the appUcant's attempt to argue 
non-analogous art; clearly, the motivational statements taken from the references noted above 
provide the factual reasoning for the combining of the references. (As an example, the Ashby 
reference pertains to the dealing of maintaining and storing voice recordings, Walter et al.'s 
system addresses the problems associated with the manipulation and maintenance of large 
number of voice recordings; and hence the presented motivational statement provided above. 
The combination of Ashby in view of Walter is further improved upon by the Jong reference, 
which teaches remote processing pertaining to text to speech and speech to text conversions; 
with the advantages of performing such processes reducing the conputational work load of the 
local devices - yet another improvement in handling speech/text conversion ftmctions, which 
was provided above in the motivational statement, referring to the Jong reference). 
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Conclusion 



4. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Opsasnick, telephone number (571)272-7623, 
who is available Tuesday-Thursday, 9am-4pni 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mr, Wayne Young, can be reached at (571)272-7582. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an appUcation may be obtained from the Patent 
Application Information Retrieval (PAIR) system Status information for published appUcations 
may be obtained from either Private PAIR or Pubhc PAIR. Status information for unpublished 
appUcations is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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